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Abstract. In this note, we try to analyze and clarify the intriguing inter- 
play between some counting problems related to specific thermalized weighted 
graphs and random walks consistent with such graphs. 



1. Introduction 



The purpose of this work is to underline the subtle relationship between some 
counting problems related to thermalized weighted graphs and random walks con- 
sistent with such graphs; sec e.g. [1 for a detailed treatise on general random 
walks on graphs. Let us summarize the topics developed in this paper. We start 
with defining finite thermalized weighted graphs. We show that the notion of a 
graph singularity spectrum naturally arises in the problem consisting in counting 
the number of paths whose transition-energy rate is asymptotically of a given or- 
der. This spectrum is classically the Legendre transform of the graph pressure 
function which is the logarithm of the spectral radius of its weight matrix. The 
corresponding Perron eigenvectors play a key role in the Perron- Frobenius theory. 
We next recall the Gibbs-variational principle, stating that the pressure produced 
by all random walks consistent with the graph structure is bounded below by the 
graph pressure which may itself be viewed as the pressure of some consistent canon- 
ical random walk. This turns out to be a by-product of the Ruelle thermodynamic 
formalism. We then exhibit and interpret some important consistent random walks 
in the light of quasi-stationary distributions for substochastic random walks. The 
idea is to normalize the weight matrix of the graph by its norm to make it sub- 
stochastic so that, by adding an extra absorbing coffin state, we may switch to the 
study of a proper random walk conditioned to its absorption time. By doing so, 
a probabilistic interpretation of both the spectral radius and Perron eigenvectors 
of the graph weight matrix naturally comes out and at least two conditioning are 
shown to be relevant: one is to condition locally the above random walk on not 
hitting the absorbing state in one step at each iteration, the other is to condition 
it on not hitting the absorbing state in the remote future. The latter construction 
is shown to be the canonical random walk with smallest pressure production rate. 
At the end of the paper, we briefly discuss three particular cases, namely: the case 
where the weighted graph is reduced to its adjacency matrix, the case of a potential 
weighted graph and the case of a symmetric reversible weighted graph. Several gen- 
eral conclusions that make use of the above constructions may be drawn. One is an 
expression in terms of the average transition energy of the canonical random walk 
associated to the adjacency matrix of the value at which the singularity spectrum 
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of any weighted graph attains its maximum, another is that the entropy produc- 
tion rate of the locally conditioned random walk is always bounded above by the 
logarithm of the spectral radius of its adjacency matrix, in the potential case. 

2. Finite graphs with Boltzmann weights 

Let W > be some non-negative N x N weight matrix of some finite graph (i.e. 
with non-negative entries W > 0). Let A = [A defined by the indicator 

function: 

A(i,j) = i(W(i,j)>o)e{o,i}, 

stand for the Boolean adjacency matrix associated to W. With A' denoting the 
transpose of A, we shall assume that A = A' and that A is irreducible: in other 
words, the underlying topological graph is undirected and strongly connected so 
that for each couple of states (i, j), there is an integer m such that A m > 0. 
With (3 E M, we shall choose to represent W under the form: 

(1) W(i,j) =: W (i,j) =A(i,j)e~^\ 

for some well-behaved transition energies — oo < H < +oo from state i to j, 
not all equal to the same value. The matrix Wp therefore appears to be the weight 
matrix of some thermalized weighted graph: it can be represented as the Hadamard 
product (say, *) of A with some positive Boltzmann kernel matrix Kp with entries 

(2) Wp=A*Kf). 

We note that the Hadamard A— power (A > 0) of Wp simply is = W\p = 

A * K\p, corresponding to a rescaling of (3. 

Remark: Let x\ < x 2 < ... < xn be N points on the line (circle). For some matrix 
H, we may define 

H(i,j) =H(xi,Xj) 

to be the interaction energy between sites in positions (xi,Xj) leading to a 

slightly more general spatially extended model that can be treated along similar 
lines. A 

2.1. Some counting problems arising in this context. The quantity 

n 
m—1 

is the weight of the n— path i„ := {io, i\, .., i n } which is non-null if and only if: 
A(i n ) := rim=i A (i m -i, im) ^ 0. The total product weight of n— step paths con- 
necting states (io, i n ) therefore is given by the corresponding element of the transfer 
matrix: 

n 

WJ}(i ,i n )= Y[W (i m - 1 ,i m ) = 

ii,..,i n -i m—1 

X: IlA(» m _ 1 ,i ro ) e -^- =1 «(i ra - 1 ,i ra ) = ST e~^\ 

ii, ..,» n _i m=l p=l 
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where H n (p) is the cumulative energy of the p—th path connecting (io,i n ) and 
N n (io,i n ) ■— A n (io,i n ) is the number of such n— paths. Summing over the end- 
points of the n— paths, we obtain the full partition function of energy 

n N n 

(3) Z n (f3):=Y,W$(io,in)= £ II ^(Wi.i™)=E^ ff »W, 

io,i n iQ,..,i n m—l p—1 

where N n := J^i i N n (iq, i n ) = Z n (0) is the total number of n— paths. Define 



iV„, e (a) :=# pe [JV„] : -H n (p) £ {a - e, a + e) 



the number of n— paths whose transition-energy rate is asymptotically of order a. 
We expect 



(4) 



lim lim - log N ne (a) = / (a) > 0, 

e|0 raToo n 



where / (a) = inip (a/3 — p (/?)), a G a+], is the concave Legendre transform 
of some concave pressure function p (/3). We may call / (a) the singularity spectrum 
of the weighted graph. 



Observing from ^ that Z n 



irreducibility assumption: 
(5) 



1/ra 



is a matrix-norm and recalling under our 
n|oo Pp, the spectral radius of Wp, we get 



-log Z n (J3) -* P (/3) = -\og Pl3 . 

71 njoo 



For each /?, the number pp, as an eigenvalue of Wp, satisfies det(j^Wp — l\ = 0. 
For each n, the quantity 



Zn W) 
Zn (0) N, 



-PH n (p) 



p=l 



is the Laplace-Stieltjes transform of some discrete probability measure on n— paths 
satisfying — ^ log <& n (/3) — ► p (/?) — p (0) = — log — . This limit therefore is the log- 
Laplace transform of some probability distribution which, in particular, is smooth 
and concave. The pressure p (/?) is classically related to the scaled free energy r (/?) 
by: p ((3) =: j3r (/?) . Note that, for each n, we also have: 



$n 09) 



Wn E 



-/8h„ 



h n eH„ 



where W„ := Span(#„ (p) ;p e [iV n ]) , iV„ (/i n ) := # {p £ [JV„] : (p) = /i„} and 
-^n (^n) /^n is the probability of n— paths of energy h n . 



With 1 = (1,1, ..,1), we define := Wpl to be the column-sum vector of 
Wp, with entries Wp(i) = ^ ] 4(!,j)e^' J '. Define Wp = maxj wp (i) , Wp = 
mini wp (i). We have Wp < pp < and so 

-logw+ <p((3) < -log to^. 
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Clearly, it holds that 

— logwt ~ where a_ = min^ i. A u ,-\ =1 iJ (z, j) and similarly, 

— \ogWg ~ /3a+ where a + = mauq .-.^i ,-)=i H(i,j) > a_. 

p /34--oo 

We can check that / (a_) = / (ot+) = and that the maximum of / (a) is attained 
at a = a = p'(0). We also have / (a) = f {p' {13)) = p' (0) /3 - p {(3) so that 
/ (ao) = —p (0) = logpg > where /9 is the spectral radius of A. 

Whenever a_ < 0, a + > 0, then there is a /3 C , possibly not equal to 0, given by: 
p' (P c ) = 0. With a c := p> (f3 c ) = 0, / (a c ) = -p (f3 c ) > 0. 

For all distinct pairs of nodes (i,j), let m (i,j) = inf (m > 1 : A" 1 (i, j) > 0) . Then 

= maxm (i, j) 

is the diameter of the adjacency graph. For each there can be more than 

one path of minimal length m(i, j). Let N m ^ ^ > 1 be the number of such 
length— m (i,j) paths and let h (i,j) be the energy of any path with smallest energy 
among these N m ^_j) paths. Then 

a„ = max [ft (i, j)/m(i, j)] 

(iJ) 

is a quantity of interest related to the energy diameter of the weighted graph. 
Clearly, a_ < a* < a + and a* belongs to the range of the spectrum. 

2.2. Perron-Frobenius and the like. Let 7r^ > and y /3 > be the line and 
column norm 1) Perron vectors of Wp associated to the spectral radius of 
Wp: 

(6) ppir'p = ir'pWp and pp(p = Wpipp. 

Under our hypothesis, p fj > is the algebraically simple real dominant eigenvalue 
of Wp. If A is in addition primitive (A m > for some integer to), then all the other 
eigenvalues of Wp are strictly contained within the disk: \p\ < pp, else some could 
lie on the disk \p\ = p fj because of the underlying periodicity of the problem. 

We shall let 4>p-= fp/ (ir'pi-Pf^j in such a way that the Hadamard product of irp and 
4>p, namely the column vector irp*<j>p, with components izp*4>p (i) — irp (i) (j>p (i), 
has l\— norm 1 (i.e. Tt'p<pp = !)• 

Remarks: (i) When H(i, j) = H (j,i), Wp is itself symmetric (Wp = WL) then 
TVp = ifp and irp * (ftp = tpp * tpp/ (^p'ptfp^j. Then it is useful to introduce the 

( \ 1/2 

probability wave vector of I2— norm 1 : tpp = ifp/ lippcpp] in such a way that 

TVp * Cpp = tpp *1pp. 
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(ii) Letting ep := 1 — Pp/wt > stand for the scaled spectral gap of the graph, 
the equation giving the right eigenvector cpp may be recast as 

where = -\Wp — I is a Laplacian of the graph. Observe that wt = HIW^IH is 

the matrix norm induced by the Iqo— vector norm so that pp/w^ < 1 (i.e. ep > 0) 
and that log ppj log Wp —>pioo 1. V 

Consistently with ©, we shall let tt' > and (p > stand for the line and column 
Perron vectors of A = Wq with: 

PoK = n o A and PoVo = Al Po, 
associated to the spectral radius p of A = Wo. We shall let <fi := ip Q / (7r <p ) so 
that the Hadamard product ito * <p Q has l\— norm 1. Note that, since A = A' , 

1/2 

7T = v? and * 0o = ¥>o * Vo/ (VoVo) = : * iPo where = Vol (f'ofo) is 
the wave vector associated to A. 



3. Random walks on graphs 



In the study of weighted graphs, questions pertaining to counting are then rele- 
vant. Once such weighted graphs have been introduced, it is useful to consider the 
following particular class of random walks attached to such graphs. 

Let < II = [II (t, j)] denote some stochastic matrix with column sums one: III 
I . Let Twit be the set of stochastic matrices which are Wp— consistent in the sense 
that 

(7) II 6 Vwff & {n (£, j) = whenever Wp = 0} . 

Let fi' > be the line left Perron eigenvector of n, satisfying: y! — /x'IT (the unique 
invariant probability measure associated to II). Clearly, to each such II a positive 
recurrent random walk (RW, say) can be associated. 

3.1. A variational principle and first consequences. In this context, the fol- 
lowing Gibbs- variational principle indeed holds [2], resulting from the Ruelle ther- 
modynamic formalism [10 . It reads: 

log pp= sup \-^2fi(i)^2u(i,j)\ogU(i,j) + ^2fi(i)^2u(i,j)logWp{i,j) 

neVlV V V 1 3 3 

(8) 

= sup [-^^(t)53n(i,j)io g n(*,i)- J 95^ M (t)5^n(t > i)fr(* > j) 

where the supremum is attained for the unique stochastic matrix II, which is 
Wp —consistent and defined by the Doob transform: 

(9) Il,(i,j) = -Wp(i,j)^-. 

Pp 4>p w 
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With D<p (i := diag(</> (3 ), this is also; II* = -^-D^ WpD^,^, in matrix form. The 
corresponding invariant measure satisfying = //*II* can easily be checked to be: 

(10) /Z, = 7T0 * 00, 

the Hadamard product of the left and right eigenvectors of the weight matrix Wp. 
We shall call the RW with transition probability II* the canonical RW consistent 
with Wp. Using this canonical RW construction, we get: 

logP/3 = (i)y2Wp(i,j) x-7Trlog ( ~~r~7T 

PPt j KPpPpW. 

= E^WE 1 ^ (*' 3) <Pf3 U) [~ lo SPp + log <t>p U) - log <j> (i)] 

p ^ i j 

= log ^ + V tt^ (j) <j} p (i) log ^ (i) V np (i) V Wp (i, j) (f> (j) log (f) f3 (j) . 

leading to the expression 

_ Ei (») E j (*> j) 0p (J) lp g ^ C?) 

in terms of the left and right Perron eigenvectors of W^. As a result, we obtain 

(11) p(/3 )=:/3t /? ) = -log — — — t 

Li^iS W0/3 W log 0/3 I*) 

From ((SJ), for all W^— consistent stochastic matrix II ^ II* : 

(12) iog^>-^MWX] n ( i 'J)iogn(i,i)-/3^/x(i)^n(i,i)if(i,i). 

In the right-hand-side of (O, s := - E* P- (*) Ej n (*> j) l°g n (i, j) =: E l A* (*) s (*) 
is the equilibrium Shannon entropy production rate of the ergodic Markov chain 
governed by II and u := Ei A 4 (0 Ej H (i, j) if (i, j) =: Ej A* (*) M W its equilibrium 
internal transition energy. It follows from (jHJ) that the quantity p(/3) := — logp^ 
is a universal lower bound for the equilibrium pressure production rate of all 
Wp— consistent walkers. Stated differently, defining the pressure of a consistent 
RW governed by II g V W/3 , H ^ II*, as: 

Pn 09) :=/3^M(*)£n(i ) i)fl-(i ) i) + ^/i(i)X;n(i s i)logn(i J j) ) 
it holds that: 

(13) for all II ^ II* e V Wfj , Pu (J3) >p(J3) = Pn, (/?) . 



Remark: On the other hand, we also recall the Friedland-Karlin inequality [I] of 
a similar flavor: 

(14) p (/3) = - log p p > ""/J (i) 0/3 (i) log wp (i) 
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where, w/j := Wpl is the column-sum vector of Wp : wp (i) — J^- A e~^ s ^K 
It gives a universal lower bound of p {(3) in terms of the invariant measure fi* (i) = 
Tip (i) (j)p (i) associated to II*. A 

3.2. The entropy production rate of the RW governed by II S Vw - We 
need to say a few words on the way to compute the quantity s associated to some 
II. We refer to [5] for additional information. For each pair of connecting states 
(io, i n ) , define: 

n 

n"(i ,i n ):= ^2 JJ n(i m _ x ,i m ) , 

il,..,i n _i m—1 

where II (i m _i, i m ) A is the (i m -i, im) entry of II* A , the Hadamard A— power of II, 
A > 0. Define the Renyi A— entropy of all n— paths of the RW governed by II and 
started using the invariant measure fi to be 



Rn (A) := — ^ log V (io) U n x {i , i n ) 



Note that with II (i„) := Um=i n (* 

m— i,im) the probability of the n — path i n : — 

{io,ii,-,i n } ■ 

R n (A) ►vfi S n = — (i ) II (i„) logll (i„) , 

In 

the Shannon entropy of n— paths at equilibrium. Then, with a (A) := fi (i) Ylj H 

(15) -i?„(A) r r(A) := —L- log a (A) 

where r (A) is the Renyi-entropy production rate of the walker. As a result, 
r (A) -> A?1 s = - J2 » (0 E 11 (*> J") lo S 11 (*' J") = - a ' C 1 ) ' 

i J 

This approach is useful to compute the Shannon-entropy production rate s for 
specific lis. 

3.3. Random walks consistent with Wp. We now exhibit and interpret some 
important Wp— consistent RWs in the light of quasi- stationary distributions for 
substochastic RWs. By doing so, a probabilistic interpretation of pp, np and 4>p 
emerges. 

Let us first normalize Wp in the following way. Consider the matrix: 

(16) W > : =W 

for some matrix-norm \\Wp\\ of Wp. For example: \\Wp\\ = N maxjj Wp (i, j) or 
\\Wp\\ = Eij Wp or \\Wp\\ = = msxiWp (i). 

The spectral radius of Wp now is ~p~p = ppj \\Wp\ < 1 with the same left and right 
strictly positive Perron eigenvectors TTp > and (fg> as for Wp in ([6]). By doing 
so, the matrix Wp is substochastic in the sense that, with wp := Wpl the column- 
sum vector of Wp, then: uJg (z) € (0, 1] with (i) < 1 for at least one i. To recast 
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(17) P 



this problem into a stochastic problem, we may add an additional coffin state, say 
d := {0} and look at the enlarged (N + 1) x (N + 1) stochastic matrix P : 

1 0^ 

1— W/3 Wp 

P now is the stochastic transition matrix of a RW, say {X n } , having state {0} as 
an additional absorbing state. Let r be the first hitting time of d = {0} for this 
RW {X n }. 

Using this construction, clearly, the substochastic matrix Wp turns out to be the 
transition matrix of the process X n - 1 (to > n) (i.e. X n , restricted to the set To > n). 
In other words, with e' io the line- vector with a single 1 in position io, elsewhere, 
we have 

P io (X n = i n ,r >n) = W n fi (i ,i n ) = e' lQ Wpe in , i ,i n G {1, ., N} . 
Therefore, 

(18) P 40 (t > n) = e' lo W;i. 

We note that P io (to = 1) = P io (to >_0) - Pi (r > 1) = e' iQ (/ - Wp) 1 = 1- 
wp (io) , the probability mass defect of Wp at state io- 

r „ ] 1/n 

For all (io, i n ), we have: limnfoo W p (io, i n ) = pp and, only when A is primitive 
(irreducible and aperiodic) , by the strong version of Perron- Frobenius theorem (see 
i) 

(19) ]impp n W; = <t> f3 ir' f3 , 

where ir'p > and <pp > 0, defined in ©, are the left- (right- ) eigenvectors of Wp 
associated to pp, chosen, as before, so as to satisfy ir'p4>p = 1. As a result of l|18p 
and pop , when A is primitive: 

(20) lim p- n P l0 (t >n) = <f>p (i ) , 

nfoo ^ 

meaning that To is tail- equivalent to a geometric random variable with success prob- 
ability ~p~p. The latter formula therefore gives the limiting interpretation of <pp in 
the context of the RW {X„}. What about 7Tg? 

Firstly, because 7r^ is the left eigenprobability vector of Wp with eigenvalue ~p~p : 

N 

(21) P^ (t >n):=Yl ^ Fi <> ( r ° > n ) = 7r '^ 1 = % 

i =l 

If the process is started with irp, the law of t is exactly geometrically distributed 
on {1, 2, N} with success probability pp. 

Consider now the conditional probability Pi (X n = i n \ To > n) . 
Recalling F i() (X n — i n , t > n) = e'^W^e^ , by Bayes rule, we get 
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showing that, independently of the starting point io 




= 7T/3 {i n ) ■ 



Such a probability measure Tzp is called a Yaglom limit [IT] of {X n }. 
Further, with (■) := £^7173 ( l o)P*„ (•), for each n, *„ £ {1,2, ..,N} : 
(22) P W/J (X„ = i„ I to > n) := 

(^n = in, tq > n) _ ir' Wpe in _ 

and this precisely means that -n^ is the (unique) quasi-stationary distribution 
(QSD) of {Y„}. As is well-known for Markov chains with finite state-space ab- 
sorbed at d, we observe that the Yaglom limit coincides with its QSD. When A is 
primitive ( strongly connected and aperiodic ), Equations \21\) . \22\l and \20\) provide 
a natural interpretation of p g , irg and <pg in terms of the RW governed by P in 
and its stopping time tq. 

We refer to [7] for additional informations on QSD and Yaglom limits in the context 
of population dynamics. 



Remark: When A is irreducible but not primitive (the underlying topological 
graph is strongly connected but periodic), only the following weaker form of the 
Perron-Frobenius theorem holds true [6] 

1 K __ — n 

n— 1 

With cf)p = maxi <pg {i), <f>~^ = mini 4>p (*)j Equation ()20|1 has to be weakened into 
<Pp/<Pp < P^"P 40 ( T o > n) < for all n, i Q . 

The quantity p^™Pi (to > n) may oscillate and not tend to some limit; however 
— ~ logP io (t > n) — > still holds true. A 

The above construction of the RW {X n } allows now to interpret two fundamental 
Wg — consistent RWs. 



The locally conditioned random walk: With D^p '■= diag(w/3), the transition 
matrix of the one-step conditioned process {X\ \ tq > 1) is: 



n(u) 



e'Wge 



<W B e 3 
e'AVel 



D w lWg 



normalizing each line i by e'^Wpl — wg (i) . Clearly, 111 = 1 and the RW with 
transition matrix : 

(23) u = d-\w b 

is Wp— consistent. Note that II is invariant under the scaling Wp — ► Wg. 
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Let fj, be the invariant associated to this II. It holds, [9], that 



where (7 — 11)^ . is the cofactor of the (i, i) —entry of the matrix I— II. Then, if II is 
the transition matrix of the reversed (backward in time) chain of II at equilibrium: 
II' = DfJlD^ 1 . In general, II ^ II and detailed balance may not hold. 

Global conditioning and the canonical process. Consider now the proper 
Markov chain whose transition probabilities are obtained by the Doob transform: 

9/3 W p <M J ) 

satisfying 11*1 = 1. In matrix form: 

(24) n^p^D^WpD^, 

and II* is also invariant under the scaling Wp — ► Wp. An important property of 
this RW is the following: The probability II, (i n ) := IIm=i (4-1,4) of the 
n— path i n is 

For a bridge n— path for which «o = in, II* (i n ) = pZ n Wp (i„) reduces, up to a 
scaling constant, to the weight Wp (i„) of the n— path i n . 

The invariant probability distribution /x„ on {1, .., TV} satisfying /x'*n* = jti* exists. 
It is given explicitly by /x^ = 7T/3 * <Ag and so: 

(25) ^(i)=irp(i)<j>p(i),i = l,..,N. 

Doob transforms have to do with conditioning a process on its lifetime. The Markov 
chain with one-step transition probability matrix II* may be shown to be the one 
of the process whose one-step transition probability distribution is: 

(26) n* = lim P, (X 1 = j | r > n) , 

n\oo 

corresponding to X n conditioned to never hit the coffin state d = {0} in the distant 
future; see [7]. This process has a unique invariant measure given by fi^ in (|25[) . 

Defining as before II* by: II'„ = D ^TL^DZ 1 , we can ask conditions under which 
detailed balance II* = II* holds. We have 

n* = p^D^D^D-^WpD^D^D-l = p^D^WpD-] 

so that II* = pp D^WpDnp showing that reversibility holds when Wp = W' fi 
since if this is the case: irp = (f>g. 



No extra state. We emphasize here that there are some alternative ways to force 
the substochastic problem into a stochastic one. Assume A(i,i) > for each i, 
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in which case A 1 > and A necessarily is primitive. Consider the stochastic 
matrix II which is Wp — consistent: 

(27) IL = Wp + D 1 _^, 

where -Di-w a : — diag(l — W/3), satisfying III = 1. In that case, the mass defect 
vector 1— w,g is transferred to the diagonal entries of W p to make it stochastic, 
without appealing to an extra coffin-state. Note that II in (|27[) no longer is invariant 
under the scaling Wp — > Wp and so this normalization is norm-dependent. 

4. Special cases 

1. The topological case. Assume (3 — 0. In this case, Wq = A and 

log A) > s = - ^2^{i)^2^-{i,3)^ogI[{i,j) 

i i 

for all A-consistent matrix II ^ 11° with: 11^ (i, j) = j-A(i,j) logp > 

interprets as the maximal entropy production rate of all Markov chains governed 
by such lis. The RW with transition matrix II" is termed the maximal entropy 
random walk in [3 . Its invariant measure is /i„ {i) = V 00 ■ When II = D a l A, 
with a = Al, the invariant measure is /i(i) — a (z) / a (i) . proportional to the 
node degrees. Then s — ^ a (i) log a(i) / J2i a (*) an d log Po > s is an inequality 
first discussed in [3J. When disorder is present, the canonical RW associated to 
Wq = A was also shown therein to exhibit localization properties. 

Consider the general inequality ([12"]) for all Wp— consistent stochastic matrix IT ^ 
IT =: y-Wp ^rjT)- Choosing for II the above particular value: II = 11^, we 
obtain 

log pp >\og Po -pJ2 M 2 E H * (<> 3) H (*. 3) ■ 

i 3 

Therefore, the average transition energy 

(28) a :=EVoW 2 En2(i,j)iJ(i,j) 

» 3 

interprets as the slope at (3 = of the graph pressure function (3 — > p([3), namely: 
"o = P (0) ■ We have / (a ) = -p (0) = logp . 

2. The potential case: Assume H(i,j) — U (j) — U (i) for some potential U 
attached to the nodes of the graph. In this case, the matrix Kp defining Wp is called 
a potential kernel. Firstly, in this case, it follows from (|28p and the equilibrium 
property of = ip * ip ,Il1) that: 

(29) a := ]T % « 2 £ 11° [U (j) - U (i)} = 0. 

i 3 

We conclude that the singularity spectrum of all graph with potential kernel Kp 
attains its maximum at ao = 0. 



With wp the column- vector with entries vp (i) = cxp— (3U (i), we get: 
(30) Wp:=A*Kp = D^AD V0 . 
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We have wp = Wpl = D v ^Avp and D W/3 = D v ^Da V/3 - Note that Wp is diagonally 
similar to A so that the spectral radius of Wp is p , independently of /?. 

- Consider first the RW with transition matrix II = D~^Wp = AD Wfj . Its 
invariant measure is characterized by: fi' = fi'H. Recalling A = A', we find 
fj, oc D Vf3 Avp, with normalized entries weighting output degree nodes with lowest 
U: 

(31) /* (i) = £ A (i, j) e -^+^/J2 A (i, j) e-WM\ 

3 i,3 

This RW with transition matrix II is reversible because II = D^Ii' = II. 

- Secondly, consider the canonical RW consistent with Wp = D~^AD V/} . The right 
eigenvector cf)p of Wp = D~^AD V/3 is 4>p = D~^cp . It is associated to the eigenvalue 
p Q . Thus the canonical RW has transition matrix II* is given by: 

(32) IT = Po'D^WpD^ = p-'D^AD^ = E°. 

Its invariant measure is 7r* = ip * xp . The canonical RW consistent with the po- 
tential weight matrix Wp = D^^AD Vfj always coincides with the canonical RW 
consistent with its adjacency matrix A governed by II*. 

With II = D~ 1 Wp with entries 

II = A e -«tf W>-tfW> / £ A e -«^«)-^W) , 

3 

and with invariant measure p (i) displayed in (|3ip . for all 0, we get 

iog Po > -^ M (z)^n( i ,j)io g n( i ,j)-/3E^WE n ( i ^')( f/ ^)-^W) 

i 3 i 3 

= -£M«£n(i,j)logII(i,j) = a. 

i 

We conclude that for potential kernels Kp, the entropy production rate of the RW 
with probability transition matrix II = D~^Wp — [A * Kp] is always bounded 
above by logp . 

Remark: The Wp— consistent RW with transition matrix II = D~*Wp associated 
to the weight kernel Wp = AD Vfj was also considered in [5]. For this model, the 
cost of a transition from i to j only depends on the terminal state, regardless of 
where one starts from. Although the latter is not in the potential class, its invariant 
measure is also given by (|3ip . V 

3. The symmetric case. If H — H(j,i), then Wp = WL itself. For example 
H (i,j) — \U (j) — U (i)\ for some potential U attached to the nodes of the graph, 
or H(i,j) is some distance (ultrametric or not) between nodes i and j. In this 
case, for all /?, the invariant measure /x* of the canonical RW governed by II* = 
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(33) fi„ = ip p * i/tp 

and the corresponding RW is reversible. 

When W/3 = W'p, the invariant measure associated to II = D~*Wp satisfying 
fi' = fi'Il is given by: 



We have IT = D^UD' 1 = D^^D^WpD^ = WpD~\ = IT so that II = n : 
detailed balance also holds. 
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